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11.1.1 Counting Processes 

In some problems, we count the occurrences of some types of events. In such scenarios, we 
are dealing with a counting process. For example, you might have a random process N(t) that 
shows the number of customers who arrive at a supennarket by time t starting from time 0. For 
such a processes, we usually assume MO) = 0, so as time passes and customers arrive, N(t ) 
takes positive integer values. 


Definition 11.1 

A random process {N(t), t 6 [0, oo)} is said to be a counting process if N(t) is the number of 
events occurred from time 0 up to and including time t. For a counting process, we assume 

1. M0) = 0; 

2. M0 e {0, 1, 2, •••}, for all t G [0, oo); 

3. for 0 < .s' < /, M0 - M0 shows the number of events that occur in the interval ( 5 , /]. 


Since counting processes have been used to model arrivals (such as the supermarket example 
above), we usually refer to the occurrence of each event as an "arrival". For example, if M0 is 
the number of accidents in a city up to time t, we still refer to each accident as an arrival. 
Figure 11.1 shows a possible realization and the corresponding sample function of a counting 
process. 


0 


First Arrival Third Arrival 


ft To T3 T4 • • • time(t ) 

Second Arrival Fourth Arrival 



Figure 11.1 - A possible realization and the corresponding sample path of a 

counting process.. 
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By the above definition, the only sources of randomness are the arrival times 7}. Before 
introducing the Poisson process, we would like to provide two definitions. 

Definition 11.2 

Let {X{t), t G [0, oo)} be a continuous-time random process. We say that X(t) has independent 
increments if, for all 0 < h < h < h- < t„, the random variables 

X(t 2 )-X(t x ), X(t 3 )-X(t 2 ), -, X{t n )-X{t n _ x ) 


are independent. 

Note that for a counting process, N(t) - N(t r _ j) is the number of arrivals in the interval 
(tj_ |, tj]. Thus, a counting process has independent increments if the numbers of arrivals in 
non-overlapping (disjoint) intervals 

(t v t 2 ], (t 2 , t 3 ], •••, ( t„_i,t n \ 

are independent. Having independent increments simplifies analysis of a counting process. For 
example, suppose that we would like to find the probability of having 2 arrivals in the interval 
(1,2], and 3 arrivals in the interval (3, 5]. Since the two intervals (1,2] and (3, 5] are disjoint, 
we can write 

p{l. arrivals in (1, 2] and 3 arrivals in (3, 5] 

p(l arrivals in (1, 2] 1 • Pi 3 arrivals in (3, 5] 



Here is another useful definition. 

Definition 11.3 

Let {X(t), t G [0, oo)} be a continuous-time random process. We say that X(t) has stationary 
increments if, for all t 2 > t x > 0, and all r > 0, the two random variables X(t 9 ) - X(t x ) and 

X(t~, + r) - X(t | + r) have the same distributions. In other words, the distribution of the 
difference depends only on the length of the interval (t x , L>], and not on the exact location of 
the interval on the real line. 

Note that for a counting process N(t), N(t~,) - N(t x ) is the number of arrivals in the interval 
(t x , t n \. We also assume A'TO) = 0. Therefore, a counting process has stationary increments if 
for all t 2 > t x > 0, N(t 2 ) - N(t x ) has the same distribution as N(t 2 ~ t x ). This means that the 

distribution of the number of arrivals in any interval depends only on the length of the interval, 
and not on the exact location of the interval on the real line. 

A counting process has independent increments if the numbers of arrivals in non-overlapping 
(disjoint) intervals are independent. 
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A counting process has stationary increments if, for all / 2 > /1 > 0, N(t 2 ) ~ N(t j) has the same 

distribution as N(t 2 - t|). 
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